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Abstract. The analytic solution to the dynamics of the Sherrington-Kirkpatrick 
model was developed in the nineties. It involves directly measurable out of equilibrium 
quantities, and thus addresses the questions relevant to an experimental system. We 
here review the out of equilibrium relaxation of this model and how it compares to 
experimental measurements. 
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1. Introduction 

Most analytic studies of spin-glasses carried out before the early 90s focused on their 
Gibbs-Boltzmann measure. The use of the replica trick, the cavity method and the 
Thouless-Anderson-Palmer (TAP) approach yielded a rather complete description of 
the equilibrium states of the Sherrington-Kirkpatrick model [1] and other disordered 
systems. The picture that emerged is one of an extremely complex free-energy landscape 
with many minima, the lowest of which are the equilibrium 'pure states'. The 
geometrical organisation of these states, and their relative weights in the equilibrium 
measure are the main objects in the Parisi theory [2], at the centre of which is 
the functional order parameter P{q) giving the probability that two equilibrium 
configurations in a randomly chosen sample have an overlap q. 

A much more difficult programme, not quite completed yet, concerns the 
understanding of the organisation of the landscape away from the equilibrium 
configurations. Questions such as the metastable state stability, their basins of 
attraction, and the nature of the 

barriers separating them, have proven to be much harder to answer in an 
unambiguous way. This more detailed knowledge of the landscape may seem 
a necessary condition for the understanding of the experimental, non-equilibrium 
situation. Surprisingly enough, it turns out that a direct solution of the out of 
equilibrium dynamics is in fact quite simpler. 

The dynamic approach was pioneered by Sompolinsky and Zippelius in the early 
80 's, as a method to avoid the use of replicas for the calculation of equilibrium 
quantities [3]. They introduced the general framework and succeeded in calculating 
the high-temperature quantities. The low-temperature situation turned out to be more 
complicated, and the problem of finding a true dynamic equilibrium solution remains 
open to this day. 

An alternative approach, developed in the early 90's, is to study the out of 
equilibrium dynamics starting from a quench in temperature, just as in the experimental 
protocols [U [5]. Although one might have expected that such a situation is hopelessly 
difficult, as it involves the landscape far from equilibrium, including the basins of 
attraction and barriers associated with metastable states, it turns out that the actual 
analytic solution is only slightly - if at all - harder than the equilibrium one using 
replicas. 

In general, the Gibbs-Boltzmann measure can be explored with a stochastic process 
that satisfies detailed balance. In order for the system to equilibrate, the limit of large 
times taken before the thermodynamic limit: 



Times are measured after a preparation instant, typically the moment when an 
instantaneous quench into the high or low-temperature phase is performed and 
temperature is henceforth kept constant. The order of limits ([1]) guarantees ergodicity 
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since barriers can be overcome at sufficiently long times for finite A^. The equilibrium 
thermodynamical values of any operator O are then obtained as the long-time limit of 
noise averaged time- dependent observables, {0)eq = limTv^oo linit^oo( ). 

The existence of divergent barriers in spin-glass mean-field models led 
Sompolinsky |6| to postulate that these systems relax in a set of hierarchically ordered 
time scales that eventually diverge with N. These A^-dependent timescales entered the 
solution proposed for the saddle-point equations of motion via the time-decay of the 
correlation and response functions. In this Ansatz, although equilibrium was assumed, 
the the fluctuation-dissipation relation between correlation and response was violated. 
As several authors pointed out, this is clearly inconsistent [21 E E]: the problem can 
be traced back to the fact that the saddle point dynamic equations are only valid when 
A^ — > oo and the times are kept finite. In any event, both the existence of many 
timescales and the important role of the fluctuation- dissipation relations were found to 
be crucial features of the problem that reappeared in later developments. 

A different situation, closer to the experimental procedure, is to consider the 
relaxation of infinite systems at long but finite times using initial conditions that are 
not correlated with the quenched disorder [3] . The order of limits is then 



Divergent barriers in the thermodynamic limit imply ergodicity-breaking: the 
relaxational dynamics does not explore the full phase-space in finite times at large A^. 
In fact, there is no equilibration time t^q such that for all subsequent times the system 
reaches either the Gibbs-Boltzmann distribution or any time-independent distribution 
in a fixed, restricted sector of phase space. The dynamics is for all times something 
different from local equilibrium. This is the phenomenon of aging: the relaxation of the 
system depends on its history at all times. Though aging effects lie beyond the scope of 
thermodynamics, they have been observed in numerous disordered systems. As we shall 
see below, the dynamics of mean-field disordered models ([2]) capture aging phenomena 
with similarities and differences from what is observed experimentally. 

In what follows we summarise what is known about the out of equilibrium dynamics 
of the Sherrington-Kirkpatrick (SK) model [1]. We describe the analytic solution to the 
relaxational dynamics in the limit ([2]) [5], |9] and we briefly confront its behaviour to the 
one observed in experimental systems. 

2. The Sherrington-Kirkpatrick (SK) model 

The SK Hamiltonian is if = — Y,i<j JijSiSj where the interaction strength Jij are 
independent random variables with a Gaussian distribution with zero mean and variance 
[Jj^] = 1/(2A^). The square brackets stand for the average over the couplings. The spin 
variables take values ±1 [1]. 

Although the natural dynamics for Ising spin systems are of Glauber [10] or 
Montecarlo type, these are not well adapted to implement analytical calculations. It 
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is then preferable to transform the discrete variables into continuous ones and to use 
Langevin dynamics [3]. The Hamiltonian of the soft-spin SK model is then 

N 1 ^ 

H = J^i^i^j + « IK^i - 1)^ + H K...irSh ■■■Si, , (3) 

i<j i ii<...<ir 

— oo < Si < oo, \fi. Letting a ^ oo one recovers the Ising case, although this is not 
essential. Additional source terms {hi^,,,i^ time-independent) have been included. If 
r = 1 the Zeeman coupling to a local magnetic field hi is recovered. 
The dynamics is given by the Langevin equation 

T,'dMt) = -^^ + m)+m (4) 

To determines the time scale and it is henceforth set to one. ^i(t) is a Gaussian white 
noise with zero mean and variance 2/csT and we set fc^ = 1 hereafter. fi[t) represent any 
other perturbing force. For example, non-potential forces are important in the analysis 
of rheological experiments and are mimicked as 

/. = eE4^. (5) 

with Jj" an antisymmetric matrix, Jf^ = —Jji- Forces that oscillate in time can be used 
to mimic the slow relaxation under shaking of systems such as granular matter. Such 
forces maintain the system in a driven out of equilibrium regime even if the limit ([1]) is 
considered. The mean over the thermal noise is hereafter represented by ( . . . ). 

The dynamics of a Langevin process is usually expressed with a functional integral 
for the generating functional by using the so-called Martin-Siggia-Rose method. As De 
Dominicis first pointed out, one does not need to use the replica trick to analyse the 
relaxation of models with quenched disorder if the initial condition is not correlated 
with the quenched randomness [H]. The analysis of the relaxational dynamics of a 
disordered model is thus considerably more straightforward than that of the statics, 
in particular since all observables have a very clear physical interpretation and can be 
easily and directly accessed with experiments and numerical simulations. 

The sample-averaged dynamics for — oo is entirely described by the evolution 
of the two-time correlation and the linear response functions pj 
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The square brackets denote disorder average. Exact dynamic equations for the evolution 
of these dynamic macroscopic order parameters, in the strict large A^ limit taken at the 
outset of the calculation, have been written down by Sompolinsky and Zippelius [3]. 
They are rather cumbersome because, just as in the static case, the spin variables 
cannot be explicitly integrated away. Several paths can be followed to approximate the 
effect of the quartic term introduced by the soft-spin potential. One possibility is to use 
a mode-coupling approximation [12]. Another possibility is to focus on the dynamics 
close to the critical temperature, use the fact that the transition is expected to be second 
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order, and deal with the dynamic counterpart of the 'truncated model' introduced by 
Parisi for the equilibrium case. 

All parameters in the resulting large- equations are independent of N and finite, 
and have a unique solution. In the high temperature, T > Tg = 1, regime the evolution 
reaches equilibrium, while below Tg this is no longer the case. In the following we focus 
on the relaxation in the low-temperature phase. 



3. Analytic solution 

In this Section we summarise the analytic solution to the SK model [5]. 



3.1. Generic properties 

The following properties appear to be quite generic of glassy dynamics. 
Separation of time-scales. 

After a (long) time t' there is a quick relaxation in a 'short' time-delay t — t' and the 
self correlation decays to a value Qea, followed by a slower drift away. The parameter gea 
is interpreted as the Edwards- Anderson parameter that represents the size of a 'trap' or 
the 'width of a channel' in phase space. Within these traps the system is fully ergodic 
while it becomes more and more difficult to escape a trap as time passes. The correlation 
and response functions can thus be written in a way that explicitly separates the terms 
corresponding to the relaxation within a trap: 

C(t, t') = Cst{t, t') + Cag{t, t') , R{t, t') = Rst{t, t') + Rag{t, t') . (6) 

Consistently, Cst{t,t') and Rst{t,t') are assumed to satisfy the equilibrium relations, i.e. 
time homogeneity and the fluctuation-dissipation theorem (FDT) 

Cst(t,t') = Cst(t-t') „ , . ,,dC,t{t-t') 



Rst{t,t') = Rstit-t') s.y J y J 

and 

Cst(O) = 1-gea, \im.t-t' -^oo C st{t -t') = 0, 

Cag{t,t) = Qea, limt_ooCag(t,t') = 0. 

Weak erg odicity- breaking. 
The correlation satisfies: 

dCag{t,t') ^ dCag{t,t') ^ 

dt - ' df - ' ^ ' 

This means that the system, after a given time t', starts drifting away (albeit slowly) 
until it reaches the maximal distance (in general much larger than the size of a state) 
at sufficiently long times t. 

Weak long-term memory. 
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The integrated linear response satisfies: 

lim x{t, t') = lim / dt" R{t, t") = V fixed t' . (8) 

t — ^OO t — *00 JQ 

x{t,t') is the normalised (linear) response at time t to a constant small magnetic field 
applied from t" = up to t" = t', often called the 'thermoremanent magnetisation'. This 
hypothesis is crucial, since the response function represents the memory the system has 
of what happened at previous times: the weakness of the long-term memory implies 
that the system responds to its past in an averaged way, the details of what takes place 
during a finite time tend to be washed away (the 'high-school' effect). In interesting 
cases, the system however does not have only short-term memory: 

lim /* dt' Ra„(t,t') > (9) 

SO that fields acting during an appreciable fraction of the distant past have a finite effect. 



3.2. High frequency 'quasi- equilibrium' dynamics 

The Sompolinsky-Zippelius results for the equilibrium dynamics within a pure state 
can be reinterpreted in the out of equilibrium context to describe the first quick 
relaxation regime. One finds that the self-correlation decays to the plateau at the 
Edwards- Anderson parameter given by 

{r-qea) + ql = g,, = 1±^^^^ ~ 1 - r (10) 

where t = Tg — T. 

Cst{t,t')r^{l-q,a)+A{t-t')~^^^^ (11) 
with a(T) a nontrivial temperature-dependent exponent. 



3.3. Aging regime 

The dynamic equations in the aging regime can be solved by using the properties listed 
above. The slowness of the dynamics allows one to neglect the effect of the time- 
derivative and write down coupled integral equations for Cag and Rag- These equations 
are invariant under reparametrisations of time, t —>■ h{t), that transform the 'fields' Cag 
and Rag as 

Cag{t,t') ^ Cag{h{t),h{t')) , Rag{t,t') ^ h{t') Rag{h{t) , h{t')) (12) 

This invariance deserves some explanation. The complete equations of motion 
have no such symmetry. However, in the large-time limit, the equations for the 'aging' 
correlation and responses Cag, Rag become less and less dependent of the timescale, 
because time- derivative terms become less and less relevant. Only in the infinite time 
limit are time- derivatives negligible and reparametrisations become a true symmetry. 

(Broken) symmetries are related to divergent susceptibilities and large spontaneous 
fiuctuations. Here, these susceptibilities and fiuctuations will diverge only in the large- 
time (or vanishing frequency) limit. 
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Let us see this with a concrete example [13]. If we add to the equations of motion 
(jl]) a forcing term of the form ([5]), one can show that aging disappears whatever the 
value of e, and correlations become stationary at large times: 

a,(M') = c(i^^) (13) 

The time for such a stationary regime to be achieved grows with e. Hence, we have that 
the system has an arbitrarily large susceptibility with respect to the forces fi (because 
the two-point correlation functions depend strongly on them), provided we wait long 
enough. 

One can also reason in terms of spontaneous fluctuations, as we shall see below, a 
path that suggests the introduction of a 'sigma model' that encapsulates the fluctuations 
in the 'almost-flat' directions |14j . 

3.4- Correlation scales 

The analysis of the aging regime in the SK model motivated the study of generic 
properties of time correlation functions and the development of a complete classification 
of their possible behaviour [5]. 

Take three ordered times > t2 > ti, and the corresponding correlations are 
C{ti,tj) The monotonicity of the decay of the correlations with respect to the longer 
time (keeping the shorter time fixed) and the shorter time (keeping the longer time 
fixed) allows us to derive general properties that strongly constrain the possible scaling 
forms. Indeed, one can relate any three correlation functions via triangle relations [5] 

lim C{t,,t,) = fiCs2,C2i). (14) 

C(t2,ti) = C2i 
C(i3,t2)=C32 

where f{x,y) is a function that determines the form of the triangles whose vertexes 
are configurations at three large times. The fact that the limit exists is a reasonable 
working assumption. (Note that we defined / using the correlation between the longest 
and the intermediate as the first argument.) 

The function / is time-reparametrisation invariant, associative f{x,{y,z)) = 
/((x, y), z)), it has an identity and a zero, and it is bounded. Exploiting these properties 
we showed that the most general / is composed of pieces satisfying either of the two 
forms: 

fix,y)=j^^{j{x)j{y)) , isomorphic to the product. (15) 
f{x,y)= mm{x,y) , ultrametric, (16) 

This allows to classify every possible Ansatz. Note that for j equal to the identity the 
first type of function becomes simply f{x,y) = xy, hence the name. It is also possible 
to prove that the first kind of function ( JTSl) is only compatible with the time scaling 
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with h{t) a monotonically growing function. The dynamics of a given model can occur 
in two or more correlation scales. In particular, for the SK model 

i. f is isomorphic to the product for correlation values in the stationary regime, 

C > Qea, and h{t) = e*/"^. 
a. f is ultrametric for correlation values in the aging regime, C < q^a- 

Even though dynamic ultrametricity seems mysterious at first sight there is a 
simple graphical construction that allows one to test it. Take two times > ti 
such that C{ts,ti) equals some prescribed value, say C(t3,ti) = 0.3 = C31. Plot 
now C{t3,t2) against C{t2,ti) using t2, ti < t2 < t^, as a parameter. Depending on 
the value of C31 with respect to qea we find two possible plots. If C(t3,ti) > qea, 
for long enough ti, the function / becomes isomorphic to the product. Plotting 
then (7(^3,^2) for longer and longer ti, the construction approaches a limit in which 
C{h,t2) = r^{]{C^i)/ j{C{t2,ti))). If, instead, C31 < qea, in the long ti limit the 
construction approaches a different curve. 

A preasymptotic scaling that leads to ultrametricity in the limit of diverging times 
has been found by Bertin and Bouchaud in their study of the dynamics of the critical 
trap model [15]. Indeed, it is simple to check that for any three correlations scaling as 

C(M')^i^ (13, 

relation flTB]) is recovered asymptotically. 

Ultrametricity in time is also very clear for a driven system satisfying (fT3|l . In the 
limit of small e one can check that C{t^ — ti) = min[C(t3 — t2),C{t2 — ti)] There is some 
evidence for it in the 4d Edwards-Anderson (EA) model. In 3d instead the numerical 
data does not support this scaling |16j. Whether this is due to the short times involved 
or if the asymptotic scaling is different in 3d is still an open question that will probably 
never be answered numerically or experimentally, as it was argued in Ref. [13] that time 
ultrametricity would take astronomic times to show up even if present asymptotically. 

3.5. Fluctuation- dissipation theorem (FDT) 

The analytic solution is such that, in the asymptotic limit in which the waiting-time t^ 
diverges after N ^ 00, the integrated linear response approaches the limit 

lim x{t,t^)=x{C) (19) 

C{t,t^)=C 

when ty^ and t diverge while keeping the correlation between them fixed to C [5]. 
Deriving this relation with respect to the waiting time t^,, one finds that the opposite 
of the inverse of the slope of the curve x{C) is a parameter that replaces temperature 
in the differential form of the FDT. Thus, using Eq. (fT9l) one defines 

TeffiC) ^ -ix'iC))-' (20) 

{ks = 1), that can be a function of the correlation. Under certain circumstances one 
can show that this quantity has the properties of a temperature [Ij 
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One of the advantages of this formulation is that, just as in the construction of 
triangle relations, times have been "divided away" and the relation (|T9l) is invariant 
under the reparametrisations of time ( fT2i) . Moreover, the functional form taken by 
x(C) allows one to classify glassy systems into sort of 'universality classes'. 

Equation (ITQll is easy to understand graphically. Let us take a waiting time tw, 
say equal to 10 time units after the preparation of the system (by this we mean that 
the temperature of the environment has been set to T at the initial time) and trace 
x(t,tuj) against C{t,tyj) using t as a parameter (t varies between and infinity). If 
we choose to work with a correlation that is normalised to one at equal times, the 
parametric curve starts at the point (C(t^, t^) = 1, xi^w, tw) = 0) and ends in the point 
{C(t c)0,t^,) 0,x(t oo,tw) = x)- Now, let us choose a longer waiting time, 
say tw = 100 time units, and reproduce this construction. Equation ( fT9|) states that if 
one repeats this construction for a sufficiently long waiting time, the parametric curve 
approaches a limit x{C). 

In the SK model one finds 

' 1 - C , C >qea 

. l-qea+ {qla - C^) , C < q^a 

This result corresponds to having a succession of temporal scales each one with an 
effective temperature, Te//(C). 

The question as to whether this behaviour strictly applies to the finite dimensional 
case remains open. Fluctuation-dissipation violations, i.e. the existence of Tg// 7^ T in 
the infinite waiting-time limit do exist, for instance in systems with growing domains, 
but we still have no examples in which we are certain that T^ff stays bounded away 
both from T and from infinity t, in the large waiting-time limit (the latter being the 
case for coarsening models). Numerical simulations in finite dimensional spin-glass and 
structural glass models show a clear deviation from FDT during the out of equilibrium 
relaxation but these are obtained for finite times and although these times are relatively 
long it is hard to extract the truly asymptotic limit. 



Tx{C) 



(21) 



3. 6. Functional dynamic order parameter 
In [1] a set of generalised susceptibilities 
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and their generating function Pd{q) 
1 — lim lim — y 



h=0 



(22) 



ll<...<lr L 



6{s,,{t)...sUt)) 

5 hi, 



J h=0 



Cdq'P,{q')q" ■ (23) 

JO 



were introduced. The physical meaning of Pd{q) is clear. If the order of large system 
size and long time limits are reversed the generating functional becomes Parisi static 
functional order parameter. 



Out of equilibrium dynamics 



10 



The analytic solution of the non-equilibrium dynamics of the SK model is such that 
Pd{(l) = P{(l) ^ even if the physical situations that these two order parameters describe 
are very different [5]. All generalised susceptibilities converge, then, to the equilibrium 
values [18]. This result suggests that the landscape the SK dynamics visits at different 
long times is similar to the one that characterises the equilibrium pure states (though 
with finite barriers separating the traps visited dynamically). Although at long but 
finite times with respect to the SK model explores regions of phase space that it will 
eventually leave never to return, some geometrical properties of these regions coincide 
with those of the equilibrium states. 

A similar conclusion was reached in a slightly different context in Ref. [9]. The 
quantities studies there were the staggered auto-correlation and linear response: 



where A denotes the eigenvalues of the N x N random matrix Jij associated with 
the eigenvectors |A). |o"(t)) is the time-dependent A^-dimensional vector of spins, 
ai{t) = (i|cr(t)), and o-\{t) = (A|cr(t)) are the staggered spin states. We showed that the 
staggered auto-correlation distribution C(A,C), between two large and widely separated 
times ti and ^2 chosen such that C{ti,t2) = C < qea coincides with the static one 
computed with configurations belonging to two equilibrium states with mutual overlap 
C. Moreover, if one stores the configuration at times t2 and let the system evolve 
up to a time such that again C(t2,^3) = C one obtains the same form for the 
staggered correlation C{X,t2,t3). (Note, however, that due to the system's slowing 
down, t2 - ti < ts - t2 ii C < Qea-) 

The one-time quantities (e.g. nonlinear susceptibilities and staggered magnetisa- 
tion) derived from the dynamics of the SK model thus coincide with those calculated 
in equilibrium. This fact, though rather surprising for a mean-field model, has been 
derived under certain assumptions for finite-dimensional models |36j . 

At the mean-field level, this coincidence holds for models that do not have a 
'threshold' level below which the system cannot penetrate in finite times with respect to 
A^. Examples are e.g. the SK model and the model of a manifold in a random potential 
with long-range correlations fiSl fT9]. both having a continuous set of correlation scales 
and being solved by a full replica symmetry breaking (RSB) scheme at the static level. 
Instead, there is no reason why the free-energy landscape explored dynamically should 
resemble the static one in models with a threshold, such as the p-spin spherical model [1] 
(that is characterised, statically by a one-step level of RSB). 

Let us remark that the good agreement between the numerical calculation of 
C(A,t,t) for large t and the static distribution C(A), see Fig. [H constitutes a rather 
detailed test of the solution of the out of equilibrium dynamics for this model. Further 
studies of the organisation of metastable state and their relevance to the out of 
equilibrium relaxation of the SK model appeared in |20j . 



C(A;ti,t2) 



(24) 




(25) 
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Figure 1. Staggered correlation at different times given in tlie Icey. Inset: tlie overlap 
distribution at the same times. The full lines correspond to the analytic prediction [9]. 



3. 7. Temperature cycling protocols 

A means to study the dynamics in tlie glassy phase in more detail consists in following 
the evolution of the sample under a complicated temperature history. The protocols 
that have been more commonly used include temperature and field cycling within the 
low temperature phase [2T]. Different types of glasses show rather different responses 
to the change in external parameters. S'j^m-glasses show the puzzling phenomenon 
of reinitialisation of aging following a decrease in temperature, combined with the 
recall of the situation attained before the downward jump when the original high 
temperature is restored. Remarkably, when similar protocols were applied to structural 
glasses, e.g. in dielectric constant measurements of glycerol by Leheny and Nagel, 
no substantial reinitialisation was observed [21]. Experiments in dipole glasses display 
an "intermediate" behaviour in the sense that a temperature cycling provokes strong 
asymmetric results, as in spin-glasses, while they also present very strong dependencies 
on the cooling rate, a property that is not observed in spin-glasses though is very common 
in structural glasses [25] - 

Mean-field inspired researchers have interpreted the experimental results of 
temperature cycling experiments using a hierarchical dynamic picture inspired by the 
organisation of equilibrium states in the Parisi solution of the SK model. In this 
picture one assumes that spin-glasses have a large number of metastable states that are 
organised in a hierarchical fashion just like the equilibrium states. It is then proposed 
that the system is composed of (independent) subsystems whose dynamics is given by 
the wandering in such a landscape [23]. An average over subsystems has to be invoked in 
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order to obtain smooth results as observed in experiments. Instead, droplet picture [?] 
oriented researchers found the outcome of the same experiments unequivocal evidence 
for their favourite theory [22]. 

The outcome of temperature cycling experiments in spin-glasses can be understood 
within the dynamic solution of the SK model. Moreover, the reasons why these effects 
should be hardly observable in spin-glasses at very short times such as are inevitably 
involved in simulations, and they are absent in structural glasses are clear within the 
analytic solution to the dynamics of mean- field models [26] . 

The key dynamic property to explain the outcome of these experiments is the sharp 
separation of correlation-scales in the asymptotic waiting-time limit. Take a fixed (but 
very long) waiting time and let the system evolve further. Imagine at the subsequent 
time t the self-correlation is C = go < Qea- The decay below this value needs a time- 
delay that is infinitely longer than t — tw In other words, at any times t and tw the 
correlation (and linear response) can be separated in two terms, a fast and a slow one, 
such that for all time delays such that Cfast changes Csiow is fixed while, instead, if Csiow 
varies Cfast has reached its limiting value. 

The effect of a temperature jump is then very different on the fast and the slow 
scales. The easiest way to visualise it is to use Fig. H] (a). Upon changing the external 
temperature the FD plot is modified by changing the slope of the linear part representing 
the equilibrium FDT result and, in consequence, the intercept of the line with the 
curve part that remains unchanged under the Parisi- Toulouse (PaT) hypothesis [31] 
that consists in two assertions: 

i. x{C) is independent of T and H in the aging regime; 
a. qea only depends on T and go only depends on H. 

The near temperature-independence of x{C) in the aging regime of the SK model 
has been argued at the level of Parisi static solution and carries through to the non- 
equilibrium relaxation due to Pd{q) = P{(l)- It is also a very good approximation in 
the 4:d EA model as checked numerically. As far as we know, there are no tests of this 
hypothesis in the 3D case. 

For temperature T the thin solid line in Fig. H] (a) represents the equilibrium result. 
In the figure we show the FDT part for a different temperature that we called Tg{H) for 
the purposes of the discussion of experimental measurements of FDT violations. Here 
we interpret Tg{H) just as a higher temperature and qo{H) as its Edwards- Anderson 
parameter (there is no applied field). For temperature Tg[H) the equilibrium result is 
the dashed straight line. The thick black curved line is the same at both temperatures. 
The effect of a temperature change is then quite different on the slow and fast correlation 
scales. It corresponds to the clockwise or anticlockwise motion of the straight line part of 
the plot. The slow scales are just modified by a time-parametrisation (JT2l) . independently 
of the jump being positive or negative. The scales between go and qea are instead created 
or destroyed (restarted or erased) by the negative and positive temperature jumps. 
This intuitive idea - very close to the one put forward in the hierarchical explanation 
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of temperature jump experiments - can be made precise and implemented in analytic 
calculations p6l. 




An argument along the same lines allows one to explain the outcome of field jump 
experiments. 

The phenomenology of structural glasses is described by models of the p-spin type 
that realise the random first order transition scenario [28] . The aging dynamics of these 
systems occurs in only one time-scale, typically described by a simple t/tu, scaling. In 
these cases the argument described above does not apply (the decay of the correlation 
below any value C < q^a is not infinitely slower than the one that occurred before). This 
yields a theoretical justification of the fact that the outcome of temperature variation 
experiments in other glassy systems are quite different from the ones in spin-glasses. 

3.8. Fluctuations: towards a Sigma Model approach 

Observables in finite size systems fluctuate. A theory for the disorder-averaged, noise- 
induced dynamic fluctuations of finite dimensional glassy systems was proposed in [29]. 
These fluctuations are not induced by the particular realisation of quenched disorder 
but should be generated dynamically in models in which time-parametrisation invariance 
develops asymptotically. 

The natural counterpart to the coarse-grained local correlations and responses in 
finite dimensional models is, for a fully connected model, the global quantity itself. The 
latter fluctuates if the fully-connected system has a finite size. 

One of the main consequences of the time-parametrisation invariance theory of 
fluctuations is that the fluctuations in the fluctuation-dissipation relation in the aging 
regime should distribute along the global x{C) curve. In this Subsection we review the 
analysis of such fluctuations obtained numerically for finite size SK models. 

Finite size fluctuations of global quantities. 

If one wishes to show that a given system with a broken symmetry tends to behave 
like a Sigma model in some limit, what one has to do is to plot the fluctuations of 
the 'radial' variables that are left invariant by the group, and check that they become 
vanishingly small compared to those of the 'angular' variables generated by the group 
itself. In precisely that spirit, in order to show that the system's fluctuations explore 
preferentially the (almost) flat directions generated by reparametrisation invariance, one 
can plot the fluctuations of correlations and responses in such a way as to show that 
fluctuations of quantities left invariant by this group (the departures from a x vs C 
curve) become negligible with respect to fluctuations generated by reparametrisations 
(along the x vs C curve). 

Figure [2] shows the level curves of the joint probability of the global susceptibility 
and correlation of an SK model for a system with = 512 at T = 0.4. The distribution 
functions were obtained using 10 pairs (C(t,t^),x(t,t^)) with 10^ different noise 
histories, and repeating this procedure with 10 different realisations of disorder. The 
straight line represents the equilibrium FDT. We see that the probability distribution is 
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peaked on the global Tx{C) curve. Thus, we conclude that different histories tend to be 
affected by random time reparametrisations, just as a Sigma model tends to fluctuate 
along the angles spanned by the group. Very similar results have been obtained in the 
3d EA model [30]. 




Figure 2. Projection of the joint probability distribution function (PDF) for the 
global susceptibility and correlations of the SK model with N — 512 and /? = 2.5. The 
strength of the applied field is i] = 0.25. A coarse-graining over time is done using 
T = 2 for = 64 MCs and t = 65, 70 MCs, and n = 2, 4, 8, and 16 MCs for t = 128, 
256, 512, and 1024 MCs. The crosses indicate values averaged over the distribution, 
the straight line is the prediction from the FDT. In panel (a) the contour levels are 
chosen at heights corresponding to 95%, 90%, and 82% of the maximum in the PDF 
for the global correlations evaluated at — 64 MCs and t = 1024 MCs. In panel 
(b) the contour levels are at 90% of the maximum and they correspond to the PDFs 
calculated at = 64 MCs and t = 128, 256, 512, 1024 MCs from right to left. Figure 
taken from [50] . 



Fluctuations in the noise- averaged local quantities 

The existence of soft modes for time-parametrisation is a feature of slow dynamics, 
quite independent of the presence of quenched disorder. In order to stress this point, 
Fig. [3] shows the distribution over sample realisations of correlations and response 
function Fig. [2l the data for each sample being averaged over the noise. The orientation 
of the contour levels does not follow the Tx{C) curve but, instead, it is approximately 
parallel to the FDT straight line. Clearly, the sample-to-sample variations have nothing 
to do with the reparametrisation invariance, which is a dynamic effect. Again, very 
similar results are obtained in the 3d EA model. 

4. Experiments 

The SK model is, undoubtedly, the mean-field model of spin-glasses. One would then 
like to confront its dynamic behaviour to the one observed experimentally. In this 
Section briefly do this by discussing some salient experimental results. 



Out of equilibrium dynamics 



15 




Figure 3. Projection of the joint PDF for the noise-averaged "local" susceptibilities 
and correlations of the SK model with N = 512 and /? = 2.5. The strength of the 
applied field is 77 = 0.125. The coarse-graining times r are chosen as in Fig. ^ The 
crosses indicate values averaged over the distribution, the straight line is the prediction 
from the FDT. In panel (a) the contour levels are chosen at heights corresponding to 
90%, 85%, 80% and they correspond to times ~ 64 MCs and t = 1024 MCs. In panel 
(b) the contour levels are at 80% and they correspond to the joint PDF at = 64 
MCS and t = 1024 MCs. Figure taken from [30] . 

4.I. Isothermal aging 

Several groups studied the relaxation of spin-glasses using ac-susceptibility and dc 
magnetisation measurements. The experimental data - as well as the numerical data 
from simulations of the 3d EA model - are rather well described by a much simpler 
time-dependence than the one found in the SK model. More precisely, neither the 
ultrametric relation ( fT6l) nor its pre-asymptotic form ( |T8i) fit the data satisfactorily. 
Instead, the data are rather accurately described by a two-scale scenario with an aging 
regime characterised by an enhanced power law, h{t) oc e''^''^*/*")), with a ~ 2, that 
weakly deviates from a simple power [?]. Note that this scaling is also different from 
the one predicted by the droplet model [27]. 

4-2. Temperature cycling experiments 

Temperature cycling experiments are amongst the most striking and beautiful ones made 
with spin-glasses. As mentioned above, the SK model responds to temperature cycling 
in a manner qualitatively very close to that of experiments. What remains a mystery 
however, is that the memory effects in the SK model arise thanks to the existence of 
many widely-separated timescales, while in the experimental system there seems to be 
only a single scale. 

4.3. Fluctuation- dissipation relation 

Direct measurements 

Deviations from the FDT should be tested by measuring the dynamic induced and 
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spontaneous fluctuations of a cliosen observable using the same experimental device. In a 
remarkable series of experiments, Herisson and Ocio carried out such a study focusing on 
the magnetisation of an isolating spin-glass sample Their results for correlation and 
linear response functions are compatible with the two-scale scenario and the enhanced 
power law aging time-scale. The direct comparison between integrated linear response 
and correlation function yields an FD plot that has been interpreted by the authors as 
being similar to the curved shape of the SK model. It should be stressed, however, that 
this interpretation is inconsistent with the understanding of the fluctuation-dissipation 
deviations as being related to the existence of effective temperatures [17], since the 
whole decay occurs in a single timescale. Moreover, in our opinion, the resulting FD 
plot cannot be really distinguished from a broken straight line which is consistent with 
a two-scale scenario and the effective temperature interpretation. The same proviso 
applies to the numerical data for the 3d EA model. 

Zero-field and field-cooled magnetisation 

An indirect study of the fluctuation-dissipation relation using several sets of 
experimental data obtained from various samples was presented in [32]. The proposal, 
motivated by discussions with DS Sherrington during a visit to the University of 
Oxford, is to use the well-known difference between the field-cooled and zero-field cooled 
magnetisation in the low T phase to infer the deviation from the fluctuation-dissipation 
relation between spontaneous and induced fluctuations. 

The approach uses a dynamic extension of the Parisi- Toulouse (PaT) approxima- 
tion [34j that we explained above. The PaT approximation allows us to estimate the 
C-dependence of the susceptibility using exclusively response results, thus circumventing 
the difficulties inherent to noise measurements. Deviations from the Curie- Weiss law 
due to a non-vanishing average of the exchange coupling in real spin-glasses were also 
taken into account. 

The strategy is to use data taken under T and H conditions such that the system 
is at the limit of validity of FDT, i.e. C{t,tw) ~ Qea- The point {qea, xilea)} is the 
intersection between the straight part (FDT regime) and the aging part of x{C) where 

xiQea) = , lim lim x{t,tn,) = ^{qd - qea) (26) 

and to associate xilea) to the zero-field cooled susceptibility Xzfc measured 
experimentally, is the equal time correlation that is not necessarily one but can be 
obtained from lim^-^o Qea- The locus of the points obtained by varying T spans a master 
curve Xag{C) which, by the PaT hypothesis, is field and temperature independent. 
At a given working temperature T the actual x{C) curve consists of a straight line 
with slope -1/T joining (g^, 0) and {qea,x{<lea)) and a second part given by Xag{C). 
The method of construction is explained in [32] and it is illustrated in Fig SI A 
complementary argument uses the field-cooled magnetisation to construct XagiC) by 
spanning xfc{H) = l/Tg{H)[qd — qo{H)) as a function of H. 

The analysis is most reliable for CuMn, a system in which the Curie- Weiss law as 
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Figure 4. Left: sketch of the x vs C plot. The thick curve represents the master curve 
Xag(C) that, within the PaT approximation, is temperature and field independent. 
The thin straight line has slope —1/T {T <Tg) and represents Eq. (|26p . The dashed 
straight line has aslope —l/Tg{H) and joins (gd,0) to {xfc{H),qo{H)). Right: Xag{C) 
plot for CuMn at 1% and 2%. The vertical axis is normalised by the susceptibility at 
the critical temperature in zero field (xo)- The horizontal axis is normalised by qd- 
The crosses are numerical results for the 3c? EA model [5S] . The inset shows the inverse 
FC and ZFC susceptibilities as functions of temperature. Figure taken from Ref. [35]. 

well as the PaT approximation are very well verified. Figure H] shows the Xag{C) curve 
determined using the ZFC data of Nagata et al for two concentrations [33]. There are 
no experimental points for C/qd> 0.8 that correspond to rather low temperatures. We 
know however that xiC) tends to zero as C ^ qd since Xzfc(T = 0) = 0. In addition, 
the slope dx/dC should be infinite at C = qd so that q = qd only at T = 0. The 
validity of the hypotheses can be judged by the inset where we show the temperature 
dependence of the inverse susceptibility for the 1.08% compound. A Curie-Weiss law 
with ^ ^ holds accurately for all T > Tg. The T-independence of Xfc required by the 
PaT approximation is also well verified below the transition. The same is true for the 
2.02% sample. For comparison, we also show the curve x{C) for the 3d EA model, at 
T = 0.7(< Tg) and H = 0, obtained numerically in Ref. [35j. The agreement between 
the numerical results and the experimental data for the 1.08% sample is remarkable. It 
may be fortuitous, however, since the results for the 2.02% sample deviate from it. In 
fact, one must note that x{C) is not a universal function. For example, it depends on the 
details of the Hamiltonian (Heisenberg, Ising and, in general, the level of anisotropy) 
even at the mean-field level. Thus, there is no reason to expect universality in real 
systems. 

Note that in real samples a spin-glass transition in a field may not exist. However, 
even if this were the case, the system should remain below a slowly time-dependent 
pseudo de Almeida-Thouless (AT) line for still relatively long times: it ages and behaves 
as a true (out of equilibrium) glass with a non-trivial x{C) that would eventually become 
a straight line with slope —1/T. 
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Another important issue is the asymptotic (t^ oo) form of the Xag{C) curve. 
Even if the system never equihbrates, the Xag{C) curve may still be a very slowly varying 
function of ty^, eventually reaching a form different from that observed experimentally. 
One is not in a position to discard this possibility. 

As was mentioned above, equilibrium and large-time non-equilibrium one-time 
quantities are expected (under certain assumptions) to coincide |36] . If these hypotheses 
are warranted for spin glasses, the slope of the dynamic x{C), for an infinite 
system in the laige-ty^ limit should coincide with the static x{q) as defined by the 
probability of overlaps of configurations taken with the Gibbs measure - the connection 
being established through the generalised susceptibilities as explained above. The 
determination of a non-trivial x{C) would thus imply a non-trivial x{q) and would 
hence validate Parisi's solution. The problem, as is usual in these systems, lies in the 
fact that the dynamics, even in the experimental case, are confined to quite short times. 

5. Conclusion 

From the dynamic point of view, the Sherrington-Kirkpatrick model has some aspects in 
which it resembles experimental systems, and some in which it does not. Amongst the 
resemblances, as we have seen, one can count the fluctuation-dissipation characteristics 
and the remarkable temperature-cycling properties of memory loss and recovery. 

On the other hand, there is the inescapable fact that one does not see any evidence of 
dynamic ultrametricty either in experimental systems or in their numeric counterparts, 
while these are easily observable in simulations of the SK model |37]. Even assuming 
that at longer times the separation of timescales would develop, this can be estimated 
to happen not before astronomic times [13j. 

As mentioned in the previous section, a non-trivial x{C) at very long times is an 
indication of a nontrivial Parisi function. The problem is that experimentally accessible 
times are not that long — coherence length scales of around twenty are estimated in the 
best of cases. An apparently nontrivial x{C) that would eventually become trivial - or 
an apparent Almeida-Thouless line disappearing at long times - would be an example of 
a phenomenon that is a permanent source of confusion: finite size systems in equilibrium, 
and infinite-size systems at short times, tend to have a pre-asymptotic behaviour that 
looks qualitatively mean-field like. This tendency can be judged as positive - because 
the mean-field picture is then a qualitative model of what we see in practice, or negative 
- because it does not allow us to distinguish properly between theories. 

The Sherrington-Kirkpatrick model was originally designed as a toy model of spin 
glass, that would serve as a straightforward, practical starting point. Fortunately for 
us, this expectation proved unfounded, as over thirty years of surprises and amusement 
have shown. 
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